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ABSTRACT 



An obvious problem in the construction of courseware for computer 
assisted instruction is the lack of analytical tools for testing the 
likely effectiveness of the courseware under construction. 
The CAD-CAI research project of the University of TVente aims at the 
development of a set of analytical tools for courseware developers, 
integrated in a production environment. A first step in the development 
of such tools is perceived to lay in the modelling of the product type* 
The general systems theory has been used as a framework for modelling 
the tutorial instructional process. An unambiguous representation was 
developed^ which served as the foundation for the realization of an 
adjustable tutorial ''machine*** This machine can operate as the execution 
mechanisa for tutorial courseware that has been developed in the form of 
a network of frames (nodes). Thus both a general model has been con- 
structed» based upon Which specific tutorial courseware can be executed 
and a basis has been laid for manipulating various design options in 
order to be able to trace the likely effects of design choices* Design 
options in respect to decibionrules for steering the instructional 
process in the context of system controlled CAI. 
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1. INTRODUCTIOM 

The production of courseware for cosputer assisted instruction (CAI) Is 
regarded to be a conplex and costly process. Various sources (Moonen and 
Gastkemper 1983 » Kearsley 1983) report production tine /on-line in- 
struction time ratios varying between 80 and 200 (in hours). 
The production of courseware is a coaplex activity because it is a 
combined process of developing computer software and an instructional 
•Srstem. Albeit an abundance of literature has been published both about 
software engineering and about the development of instructional systems » 
not quite much has been published about the engineering of courseware 
some of the exceptions being (Bork 1981» 1984). 

Even though special instruments have been developed to support the 
development of courseware such as authoring languages and authoring 
systems, a fuudamental problem is encountered during the development of 
courseware. It is more or less consciously realized by every developer 
of courseware, that no special instruments or methods exist by means of 
which the likely performance of courseware is analyzable during design. 
As a consequence it is simply not possible for a designer to calculate 
the likely effects of various design options in terms of the expected 
likely performance of the courseware. Design choices are based on edu- 
cated guesses and on trial and error based learning experiences gained 
from the development praxis. 

Gaining access to a man ipula table model of the courseware system under 
design would provide the developer with a basis for the use of special 
facilities to experimentally te^t the effects of implementing various 
design options* Such a model in combination with attached analytical 
instruments would offer the developer the possibility to systematically 
alter parameters of the system and to calculate the recults in terms of 
the expected performance of the courseware. 

The CAO-CAI researchproject, described to some extent in this article, 
embodies an atteo^t to create a workenvironment for the development of 
courseware (called the EDUC system) in which the effects of various 
design options during the design of tutorial CAI can be analyzed. As the 
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construction of iiodels Is based upon the creation of an abstract re- 
presentation of the systea under study» the researchers started with the 
developaent of an abstract tutorial system. This abstract system vas 
transformed into an adjustable tutorial software machine* forming a part 
of the before mentioned experimental vorkenvironment* 
To this vorkenvironment software instruments for analyzing the effects 
of various design options have been attached. 
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2. WHY A WORKENVIRONMENT FOR THE PRODUCTION OF TUTORIAL COURSEWARE? 

Ai CAI is based on the executior of computerprogrannes that carry out 
tha inatructional activities, these programmea ahould of courae be free 
froa syntactic errors. It is a well knovn fact that the design and 
construction of large cooputer programmes is a notorious activity in 
terns of costs in time and effort involved. 

Producing courseware however means the production of an inatructional 
system as well. The design and development of an adequate instructional 
system requires hardly less effort than the development of a larger 
scale computerprogram. It is an activity that needs carefull planning 
and a thorough knowledge of the instructional variables involved 
(Hoaiszowski 1982, 1984) Furthermore, during the development of course- 
ware explicit attention needs to be given to the oan-aachine interface, 
being the various ways the human and the computer will interact during 
the execution of the instructional computerprogram (Kearsley and 
Hillelsohn 1982). 

These three areas, computerprogramming, the development of an in- 
structional system and the development of a man-machine interface mingle 
during the design and development process of courseware. Together they 
form a difficult mix from the perspective of an attempt to produce 
quality courseware at acceptable cost. 

Several indications in the literature point out that the production of 
courseware is a highly time consuming activity as wel, tha ratios of 
production time to net connect instruction tiiue vary between 100 and 200 
(in hours), depending mostly upon the difficulty of the instructional 
problem involved, the expertise of the developers and the adequacy of 
che hardware and software tools used (Moonen and Gastkemper 1983, 
Kearaley 1983). 

It has been often noted in the literature that multi-disciplinary 
expertise (e.g. computer specialist, educationalist, graphics designer, 
psychologist) is needed for the production of quality courseware (for 
instance (Kontoa, 1984). Forming (and keeping..) viable nultidiscipli- 
nary work units often appears to ^ a difficult task (Francis 1979). 
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Keeping these problems in mind, it is no wonder that the history of the 
developnent of support tools for the production of coursevare dstes back 
as far as 1960 (Kearsley 1982) By means of these tools it was hoped that 
the production of courseware would become easier, that productivity 
could b€ increased and that the portability of courseware could be 
augmented by using back-end compilers to translate the code produced by 
these tools for different computersystems and to create a workenviron- 
sent for oulti'-didciplinary specialists. In general, these tools are 
divided in two classes, viz. authoring languages, being special purpose 
higher order application languages which facilitate the production of 
courseware (for a review see (Barker and Singh, 1982)) and authoring 
systems, being more or less integrated sets of software tools intended 
to make the production of courseware an activity for which nc 
programming expertise is needed (Kearsley 1982). 

Even though some indications in the literature can be found that 
(especially) authoring systems speed up the process of producing course- 
vare (Avner 1979, Fairveather and O'Neal 1984) the production time and 
effort involved stays rather high. Taking it for granted that designing 
and developing quality instructional materials will remain an exacting 
activity, we rather pose the question why the effort involved quite 
often does not stand up to the resulting product quality. 

A point of entry for answering this question can be found in the reali- 
sation that computer assisted instruction is a form of communication, 
taking place between a source or sender of data (the computer and in 
last instance the producer of courseware) and a receiver of data (the 
hiaan learner). Shannon and Weaver (1949) have pointed out, that three 
levels are involved in the communication of data, as far as the 
effectiveness of the message unt is concerned. 

Level 1 pert&>ins to the accuracy with which the symbols of communication 
are transmitted and received. Level 2 pertains to the precision with 
which the symbols of communication convey the meaning intend«!d by the 
sender (in our case the sender is the author of the courseware). Level 3 
pertains to the effectiveness with which the received message effects 
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conduct of the receiver in the way desired by the sender. These levels 
build upon each other* Accurate reception of the synbols of communi- 
cation is a pre-condition for the convey of the neaoing encoded in the 
symbols. Reception of the meaning of the communication in its turn is a 
pre-condition for effecting the receiver's behavior in a desired way* 

Returning to the question why the effort involved in Che production of 
courseware quite often does not stand up to the resulting product per- 
formance » at least two factors seem to be involved* The production 
technology for courseware is a not well developed field, to say the 
least. The production of courseware is still an activity based primarily 
upon experiences gained in ine developmental praxis. A typical developer 
goes through a period of some kind of apprenticeship, during which he 
typically learns to work with some authoring facility and learns a set 
of action rules, based upon which the production of courseware is 
carried out. Design choices during the production of courseware are 
mostly based upon educated guesses, combined with knowledge gained from 
trial and error based experiences in the development praxis, rather than 
on a systematic application of proven design knowledge* A fairly typical 
situation for a developing technology. 

FurthenK>re, tha developer of courseware is dependent on the adequacy 
and quality of the tools he is using* The availability of tools that 
ofler some support for the realization of effective communication on 
the three levels mentioned therefore seems an important factor. 
Looking at available software tools for courseware-producers from the 
perspective of the support they offer for the production of effective 
courseware , ve obtain the following picture. 

Level 1. The accuracy of coammication 

This level pertains to the question of being able to realize a communi- 
cation between sender and receiver that actually reaches the receiver 
and is perceptible to him. On the side of the sender this presumes a 
faultless coding of the message to be sent and a faultless sending of 
the message to take place. Faultless coding and sending means errorfree 
instructional software and support software (such as operating system 
activities involved in the distribution of the courseware). No viable 
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support tools do as yet exist for the systematic production of error 
free Instructional program code* 

Instructional prograa generators as they exist today are extremely 
United In scope and hardly ever lead to adequate courseware. The 
conpller or Interpreter used for the translation of the commands In 
machine readable code offers a mechanism however fcr the detection of 
(syntactic) errors. So the developer of courseware has to some extent a 
tool available for checking whether the program code of the courseware 
is accurate* 

Ltvel 2* The tranmmiMlon of the desired meaming 

This level pertains to the decodablUty of the message for the receiver. 
If the receiver is not able to properly decode the sent message, that Is 
to attach meaning to it, effective communication can not be realized. On 
the side of the sender this presumes that the message is coded In such a 
vay that semantic correctness during decoding can be realized by the 
rece iver. 

Support for the realization of semantic correct courseware Is to be 
found In the availability of methods that mark a developmental path or 
give a set of working directions by means of which the developer can 
systematically work from the specifications of a required product 
towards an actual product, satisfying these specifications. As far as 
the development of computer programmes is Involved one can in this 
respect think of software engineering methodologies (e.g. Jackson 1985 » 
SAOT, Ross 1977). 

As far as the development of Instructional systems is Involved, several 
instructional design approaches (e.g. Gagne and Brlggs 1974, Romlszowskl 
1982, 1984) are available. If however Integrated courseware design Is 
involved one can think of the use of Instructional (software) templates 
that In some way or other pre-structure the courseware to be produced. 
Using these templates the developer can rely upon preformatted 
instructional program structures. Quite often, the use of these 
templates leads to rather rigid and restricted courseware. 

Checks on semantic correctness are to be based upon the degree of 
congrulty between the original specifications and the characteristics of 
the product. 
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HlMrt clt«r» uaMbigue specifications were given st the start of the 
d«velopB€nt process, these checks should not be too difficult* Quite 
often however^ courseware specifications are not that unambigue. 

htwwl 3* Bffcctias conduct ia a desired mj 

This level pertains to the effect the decoded aessage has upon the 
receiver* Effecting conduct in a desired way pertains to the so called 
pregeatics problem. Pragmatic effectiveness is context dependent, that 
is the Context in which sender and receiver cooaunicate. In order for 
prageatic effective cosauaication to take place, on the side of the 
seader the felicity principle has to prevail. Jackson (1985) speaks 
about felicity being concerned with whether or not a particular act is 
appropriate in a particular context. 

Felicity in respect to the instructional events (that can be considered 
to be the instructional acts as far as the sender is involved in 
computer based learning) is based upon the integrity of the whole of 
iaatructional events that aake up the courseware. Doblin (1980) speaking 
about the pre-conditions of the pragmatics of non-textual coaauni- 
cations, sees integrity as the right assortaent and asseablage of the 
parts of which a aessage is coapcsed. 

On the side of the receiver, several pre-conditions have to be full- 
filled in order for pragaatic effectiveness to be realizable as far as 
coaputer based learning is involved* The receiver has to be sincere in 
hie/her intention to acquire inforaation, has to accept the sent infor- 
mation and to perceive the-* aessage as credible* 

For the developer of courseware, it is quite hard to know in advance 
whether these pre-conditions on the side of the receiver will be aet. 
Given this problea, however, the developer could strive after integrity 
in his courseware. Integrity in courseware then would pertain to the 
right assortaent and asseablage of instructional events to be offered by 
the courseware* 

No specific software aethods are as yet available for the support of 
realising effective courseware ss considered on this level. In the 
educational literature, the tera **foraative evaluation** is often en- 
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counttr«d» Beanlog evaluation of a product that la under developaent. In 
fonativa evaluation the product that la being developed ia teated in a 
•tapwita faahion. For inatance a prototype of inatructional material ia 
tea tad on ita functionality in a aingle claaarooa» revised and teated on 
school level afterwards. Formative evaluation as uaually carried out 
however is not baaed on a aodel of the ayatea under developaent. There- 
fore, the developer using regular fomative evaluation techniquea ia not 
abl^ in a pra-prototype product atage to teat the likely effecta of 
various design options and based upon the obtained results to chooae the 
beat ones for realizing the prototype. 

So we are left in a situation in which it is possible during the autho- 
ring of courseware to check the syntactic correctness of the coaputar 
code involved, to get uomt support for realizing semantic correct 
courseware, but little or no aupport for the realization of effective 
courseware during design. 

As the developer of courseware is dependent on the functionality and 
qoality of the tools he uaes and as theaa tools appear only to be in- 
strumental as far as testing on syntactic correctness of courseware ia 
involved, the question why the effort involved in the production of 
courseware quite often doea not stand up to the resulting product quali- 
ty, seems a little more anawerable now. 

Our praaant research ia an attempt to explore what kind of instructional 
development methodology and kinds of tools are feaaible to aupport the 
design of effective courseware (from a pragmatics point of view), given 
that syntactic and semantic correct courseware can be realized. 

Integrity of couraeware, forming a part of the pragmatica question, ia 
context dependent. As far as CAI is concerned, broadly two main catego- 
riea of inatructional context (inatructional approaches and connected 
types of inatructional goals) are involved* The question "Who ia 
ateering the inatructional process?" is a paramount divisor herein. 
System controlled CAI presumes that the computer guides the learner 
through the inatrudtional material. Typically, the instructional goals 
involved in thia category stress the importance of systematic in- 
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•Cructional activities and a strive towards a measurable increase of 
knowledge to be realized by means of the instructional activities • 
Furthermore implicit or explicit rules are involved in respect to de- 
cision processes for guiding the learner through the instructional 
material. Such a rule could be ** go to the next unit of instructional 
tisterial only if all questions in this unit are correctly answered** • 

Representatives of this category are the CAI forms drill-and-practice 
and tutoricl* DrilWod-practice is a stepwise approach aimed at proce- 
dural mastery predominantly of sequences of (cognitive) operations* 
Tutorial is primarily used- for the instruction of conceptual or factual 
relationships and often drill*-and-practice is embedded in tutorial CAI* 

Learner controlled CAI presumes that the learner is his own guide 
through the instructional material* The instructional goals in this 
category often stress the importance of opportunities for the learner to 
explore the courseware freely. The instructional process involved 
typically has a nonsystematic character; the learner decides what and 
how to learn and when he/she has learned enoughs 

Representatives of this category are the CAI forms simulation and in- 
quiry. 

Simulation, based upon a model of a part of the empirical world makes it 
possible for a learner to explore what the effects are if th^ parameters 
of the model art^ gi:^n other values* Inquiry pertains to some forms of 
retrieving from an electronic "dictionary". 

From our perspective there was a choice to be made between the two 
contexts in terms of our exploration. We have chosen for the context 
system control, as the degree of control the courseware developer has 
over the way the instructional process will take place and the in- 
structional events the learner will encounter is much greater here than 
in the context of learner control. As a consequence of this the deve- 
loper of system controlled courseware is in a better position to analyze 
the integrity and therefore the likely effectiveness of his product than 
the developer of learner controlled courseware. 
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Bvcn though the tvo foras of system controlled CAT ve have nentloned 
differ to some extent, ve have opted for an approach la vhich both foras 
can be used. Tutorial however in the main form from our point of view» 
under vhich drill-and-practice can be subsumed* 

A vorkenvironment for analyzing the likely effectiveness of courseware 
under design, should offer possibilities for analyzing the integrity of 
the desigOf for modelling the instructional process and for modelling 
the learner. By means of posing systemaflc what-if types of questions, 
the designer should be able to explore the effects of interactions 
between design characteristics, the model of the instructional process 
and the model of the learner. By using quality indicators and by posing 
criteria that should be met for an allowable design solution, adequate 
design solutions could be found, given the mentioned facilities of the 
workenvironment . px^thermore in such a workenvironieent modelling of the 
instructional process and learner should be conform the instructional 
context choosen. Preferably, the model of the instructional process 
should be developed as a connected system of adju8tabl<a units and the 
workenvironment should contain a courseware development system, in order 
to be able to trace its functionality. 

So, modelling is the first step. Schemes of tutorial (instruction) 
systems are given (among others) by Stolurow (1971), Hartley and Sleeman 
(1975) and Wagner (1981). 

Even though these schemes differ in degree of elaboration and to some 
extent in the functions embodied in them, a common divisor of these 
schemes was clearly extant. Yet none of these schemes could be used for 
our exploration as they were not developed for our research objective 
and miss the necessary degree of formalization. 
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3. GENERAL SYSTEMS THEORY AS A FRAMEWORK FOR MODELLING 

To mt^t this need of testing already in the developing stage the effects 
of alternative design choices* the construction of a aodel is essential. 
The instructional variables of this model can then be manipulated to 
test their impact on student performances. 

Conceptually! the most simple model is a qualitative model or block 
diagram consisting of blocks and errors* The blocks refer to functional 
parts of the CAI-system and the arrows connecting the blocks indicate 
that there is a relationship of some kind. 'Tutorial schemes* can be 
considered to belong to this type of models* Block diagrams provide a 
verbal description of a system by enumerating the important elements and 
their relationships relative to a given problem (March and Simon 1961). 

The qualitative model used in Lhis paper has been constructed to repre- 
sent an abstract tutorial system as a first step in building a model of 
the tutorial CAI process* and will later be transformed into an ad- 
^iustahTe tutorial software machine. 

The teaching material is localized in the subject matter block* The 
rubject matter will be represented by a collection of four so-called 
elemrntary instructional frames* in a way to be described later. 
It is typical for tutorial CAI that a small piece of the subject matter 
together with a question is presented to the student represented by the 
student bloc'c. The actual answer given by the student to this question 
is compaied with the right answer stored in the matching block. The 
result of the matching procedure is sent to the score block* 

The score b)jck and the decision block interact with each other by meaas 
of a simple feedback mechanism. On the one hand the past history of the 
student is collected in the score block* which is used in the decision 
block to decide how to proceed with the instruction. The next frame to 
present to the student is based on a detailed specification of decision 
rules depending on the student score* These rules reflect part of the 
teaching strategy and establish the route the student is going to follow 
through the network of frames. On the other hand* it is decided in the 
decision block whether the counter of the student score has to be ad- 
Justed or not. 
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Figure 1 Block diagran of a systea controlled CAI-system 
blocks: functional parts 
arrows: relationships 



As indicated before » this qualitative aodel is insdequate for our pur- 
pose » but it can serve as an aid to construct a formal model* A formal 
modal is best suited to describe the dynamic behavior of complex systems 
vith feedback phenomena and many interactions between components 
(Forrester, 1961). Such a formal model can be used to represent a 
connected system of adjustiole units. The units result from a formal 
description of the blocks in Figure 1 and they become adjustable by 
formalizing the relationships. 
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Once this adjustable tutorial softvare Bachine has beea created, It can 
be used for bringing together the right assortment and asseoblage of 
instructional events* In this vay the developer can analyze the inte- 
grity of the courseware under design vith higher chances on developing 
effective courseware • 

To formalize the block diagram the General Systems Theory is used as a 
framework. Its concepts offer the tools to give a mathematical de- 
scription of a complex whole of interacting parts (Beitalanffy 1968). In 
this paper only those concepts will be considered, Which are needed to 
formalize the block diagram. It will be indicated how the General 
Systems Th'^.ory can be used to describe the blocks and arrows in an 
unambigioi.3 way* 
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4. SOME GENERAL SYSTEMS THEORY NOTIONS 

To be able to clesslfy the blocks of Figure 1» some elementary systems 
will be introduced* 

The first elementary system to be considered is the vell-knovn black box 
(sae SC in Figure 2). From this elementary system only the relationships 
between the independent input variables and the dependent output 
variables are known. The next elementary system to be considered is the 
black box vith memory. In addition to the input and output variables 
they poasess state variables. Those dependent variables neccessary and 
sufficient to i£etexmLne the output variables together with the input 
variables are called the state variables* They contain the relevant past 
history and serve as the memory of the system. The last elementary 
system to be considered is the decision system (see DC in Figure 2). 
Decisions are taken by means of decision rules being of an *if then* 
character^ vhich means that certain prescribed actions are taken if 
certain conditions are fullfilled. 



DC 
dc 

s 




3 


; 

/ 


information 


SC 
sc 

s 


output ^ 





Figure 2 The defined elei&entary systems and the 
corresponding system variables 
DC: deciaion system 
SC: black box 

gSc^^dc. gi-^^g variables of the black box 
and decision system 
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Th« following symbols will be used to indicate the system variables at 
tine t: 

jc(t) • input variable; 
y(t) ■ output variable; 
s(t) • state variable; 
u(t) ■ decision variable; 
z(t) « inforaation variable; 

By aeans of these variables the arrows of Figure 1 can be classified. 
To describe the relationships between the arrows, it ia neccessary to 
fonHilate the general form of the two fundamental system equations: 
y(t) • f (x(t),s(t).u(t)]: output equation ; 
• (t-l-1) * g[x(t),s(t),u(t)]: state equation ; 

The information and decision equations are special cases of the output 
equations and have the same general form* 
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5. THE SUBJECT MATTER REPRESENTED BY A COLLECTION OF FOUR ELEMENTARY 
FRAMES. 

An essential role in ell four elementary fraaes is played by the 
pointers, of vhich the types I until III and IV possess respectively 2 
and A pointer refers to the next frame to be presented to the student 
after his/her response. The types I until III build up a hierarchy, by 
vhich is meant that the higher ones incorporate minimally all the pro- 
perties of the lower ones. 

It is further assumed that the subject matter is composed of frames, 
and, in turn every frame of levels. The frames are used to partition the 
instructional material, for instance, on the basis of task analysis. 
Every frame belongs to one of the four elementary types. Frames at the 
same level contain teaching materials of the same difficult, while 
frames at a higher level con- tain more difficult material. In this way 
every frame can be indicated unambigiously by a frame and a level- 
number. 

The first elementary frame to be discussed is of type I. It consists of 
several questions and is specially suited for drill-and-practice pur- 
poses. In this type pointers are distinguished. An up-pointer refers to 
a frame at a higher level, while a do%rn-pointer refers to a frame at the 
same or a lower level. Not every student -response activates a pointer 
and in such case the next question in the frame is presented to the 
student. Whether a pointer is activated or not is decided on the basis 
of the student-score in the decision block. 

In addition to all the properties of type I the second type has the 
possibility of presenting a preceding text at the start of the first 
question. Type III is, like type II, a mixture of a pure drill-and- 
practice and a tutorial frame. Along with all the properties of type II, 
this frame has the possibility of giving additional information about 
the chosen alternative. Whether this will be given or not is decided in 
the decision block again. 

The last elementary frame to be discussed is of type IV which is some- 
what diffarent from the first 3 types. It is specially suited for pure 
tutorial purposes. The essential difference with the other 3 types lies 
in the fact that now a pointer is used to relate every alternative to 
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the next fraoe to be presented. In the case of a oultlple-cholce 
question with four alternatives this means that the 'r/2','3\ a:>d 
responses are related respectively to the •A'/B'/C\ and 'D'-polnter. 
Which fraae actually la presented to the student depends for all four 
types on the past history of the student and Is controlled by the rules 
In the decision block. This neans that the designer hast to prepare all 
the fraaes containing the Instructional aaterlal as well as all possible 
routes which link these fraaes together. Also* the designer has to give 
a detailed specification of the decision rules. These decision rules can 
easily be changed by the designer without changing the Instructional 
■aterlal. This property makes the CAI-systea Into a connected system of 
adjustable units. The machine* In turn* collects the student data and 
takes the routing decisions on the basis of these data* 
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6. FORHALIZATXON OF THE BLOCK DIAGRAM USING THE GENERAL SYSTEMS THEORY 

Having introduced the elementary franes as the tools to conatruct the 
instructional material, the block diagram of Figure I can now be for- 
malized by means of the mentioned concepts of General Systems Theory 
(G.S.T.)* 

All the blocks and arrows will be interpreted in terms of both the 
elementary systems and system variables. As an example » the arrows 
leaving the matching block» the score block, and the decision block will 
be described by their system equations* This inplies that, in order to 
illustrate how the decision block works, some decision rules have to be 
specified* 

The G.S*T*-*model can be represented as shown in figure 3« 

A few more arrows have been included in the G*S«T.*Bodel to make a 
complete description possible. It can be noticed from the model that the 
blocks of Figure 1 are represented by the following elementary systems* 
The subject matter and the student block respectively by the black boxes 
SC. sub and SC. stu* The score block by black box SC. sco, whicvi has a 
memory s'^^* The matching block by decision system DC.mtc« And finally, 
the decision block by decision system DC* dec, which has a memory s^^^. 
Before starting one cycle through the G*S*T«-model some notations will 
be introduced* Above the system variable the block of descent will be 
marked «od beneath the block of destination* A system variable can be 
composed of ^|gveral components, each indicated by a number* For 
instance, u (2,t) stands for the second component of the decision 
variable at tfme t descent from the matching block and with the score 
block as a destination* 

The cycle through the G*S*T.*model starts at the subject matter block 

dec 

SC.sub. On the basis of the decision variable u the right block, 
level, and question number is selected by means of a retrieval 
mechanism* If it is decided in DC. dec to give additional information 
this is also picked up in SC* sub and presented to the student. The 
listing of the system variables and equations is attacked as an Appendix 
with a brief explanation* 
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DC. dec 
dec 

8 



ate 
dec 



8ub 
dec 



dec 



SC. 8C0 
SCO 

8 



SC. sub 



mtc 



DC. mtc 



sub 
mtc 



sub 



stu 



8tu 
mtc 



SC. stu 



stu 
dec 



Figure 3 A G.S.T.-aodel of • system controlled CAl-systen 



Once the system equations have been written dovn» the G.S.T.-model can 
easily be converted Into a computer program. The main program can be 
written by developing procedures In a modular way for each elementary 
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•yttea* The input variables appear as value-parameters and the output* 
decision t and information variables as var-parameters in the procedure 
body* The described system equations are used in the procedure body* 
Before being able to run the main program it is necessary to initialize 
the components of some system variables* 

The main program is running nov in the following way: 



initialize (student-decision, student-history); 
WHILE NOT student-decision.terminate DO 
BEGIN 

subject-matter (student-decision, block); 

raadln (input, answer); 

matching (frame, answer, matching-result); 

score (matching-result, student-decision, student-history); 

decision (student-history, frame, student-decision); 

END 



This computer program, developed by transforming the G*S*T* -model into a 
set of cooperating procedures, can be conceived as the adjustable 
torial software machine introduced in section 1* 



BEGIN 



END* 
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7. OONauSIONS 

The developneat of «n«lytic«l tools for the developer of courseware is 
without sny doubt s very prottlsini perspective* Yet the rcsd to go is 
not sn obvious one nor en easy one to walk on* 

The presented research work has demonstrated that it is possible to 
define unaabigiously a tutorial process aad to develop an execution 
■echanlsB for courseware that is both aanipulable and based upon a 
■odular and ezplidte aatheaaticel aodel* 

This aodel if integrated in a vorkenvironaeQt for courseware, csn be 
us(i^ In connection with analytical tools to trace the likely effects of 
various design options. As far as the presented research Is coacismed» 
only the choices and effects of dicusionrules in the context of systea 
controlled CAI are aaaipulsble an traceable* The presented model is a 
rathsr siaple one though it say seen coaplicated. Rather, to cover 
tutorial processes in full plurifold, it would take a fair extension of 
the presented aodel and a aore general approach still to the 
construction of system cells* Research in this directions Is carried out 
by De Diana end Vos* Furthermore, in the presented research no specific 
analytical tools have been described* Such tools are under development 
in the CAI>-CAI project, forming part of an experimental vorU environment 
for the development of coursweware (called EDUC)* Further extensions of 
the presented research can be expected from studying the contect of 
learner controlled CAI and the addition of a "memory eel" for the re- 
presentation of the shown behaviour of the learner during the 
instructional process* 
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APPENDIX 



The listing of the system variables and equations of the G.S.T.^-nodel. 

We start with a description of the output aivl information t^ariables 
leaving the subject natter block. 

sub 

y (l»t) ■ presented question and its accompanying alternatives, 
stu 

possibly preceding by a text in case of type II until IV; 

sub 

y (2,t) • presented additional information if decided in case of 
type III and IV; 

sub 

c (l»t) « number of correct alternative (1,2,3 or 4); 



sub 

s (l-fi»t) » alternative infomation belongs to the ith alternative 
mtc 

(boolean var.); K i < 4 

sub 

z (l,t) • selected block belongs to type IV (boolean var.); 
dec 



For types I until III: 



sub 

z (2,t) » number of questions in selected frav^; 



mtc 



dec 



sub 



z (3,t) - 
dec 



frame nuaber assigned to the up-pointer; 



sub 

t (4,t) - 



level number assigned the up-pointer; 



dec 




tub 

z (S|t) ■ frane number assigned to the down-pointer; 
dec 

tub 

z (6|t) ■ level number assigned to the dovn-pointer; 
dec 



For type IV: 



sub sub 

z (7,t) until z (10. t) ■ frane numbers assigned to respectively the 
dec dec 



A\ 'B', and *D*-pointer8S 



sub sub 
z (11. t) until z (14. t) - level numbers assigned to respectively the 
dec dec 

•A'. 'B*. and 'D'-pointers; 



Information variables leaving the student block: 



stu atu 

s (l.t) - z (l.t) - student answer (1.2,3 or 4); 
stc dec 



Decision and information variables leaving the matching block: 



mtc 

u (l,t) the student answer is correct (boolean varO* 

SCO 



ntc 

z (l.t) - additional information belongs to the student answer 
(boolean var*)> 
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SCO 

CoBi)OQentt of the lafomatlon variable z ( t) leaving the score block 

dec 



SCO. 



coincide vlth conponentt of the state variable s 



SCO SCO 

z (l»t) - s (l»t) " nimber of correct answers in actual fraae; 
dec 



•CO SCO 

z (2»t) • s (2»t) • total nufflber of questions which have been asked 
dec 

until tine t; 



SCO SC& 

z (3>t) [IJ] « s (3,t) [1,J] - number of times the frame with frame 
dec 

number 1 and level number J has been 
visited. 



The lAst block to be discussed Is the decision block, where^^e start 
%rith • description of the components of the state variable s (t) : 



dec dec 

8 (l,t) until s (3>t) " respectively frame, level and question number 

of the actual frame. 



dec 

The first component of the decision variable u (t) is declared 

sub 

as a defined type In PASCAL: 



dec ^ 

u (l,t) • switch " (down, ( decrease level or stay at the same 

sub *. 

level ) 

up, ( Increase level*) 

next, (%resent next question In the frame*) 

not-nised, (* frame belongs to type IV *)); 
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dec dec dec 

u (2»t), u (3,t) and u (4,t) - respectively fraoe, level and 

tub sub sub . ^ . 

question number of the possible 

nev fraae to present; 

dec 

u (5,t) - ternlnate the Instruction because of suffl«:lent 



sub 



itery (boolean var.); 



dec 

u (7»t) • terminate the Instruction because of exceeding the 

tlae (boolean var.); 



sub 



dec 

u (8»t) - terminate the Instruction because of sufficient 



sub 



mastery, Insufficient mastery or exceeding the 
time (boolean var.); 



dec 

u (9»t) - additional Information Is. presented (boolean var.); 

sub 

dec dec 
u (10. t) until u (13, t) - respectively the frame, level, question and 
sub sub 

alternative number of the additional 
Information In case of presenting. 
The components of the decision variable with destination the scoreblock 



dec dec dec dec 

u (l,t), u (2,t), u (3,t) and u (4,t), coincide with 

SCO SCO SCO SCO 

dec dec dec dec 

u (l»t), u (2,t), u (3,t) and u (9,t), respectively, 
sub sub sub sub 



Component of the decision variable vlth destination the student block: 



dec 

u (l,t) - presented text In esse of stopping; 
stu 
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Finally, the subject natter block is reached again and one complete 
cycle through the G«S«T«-nodGl has been completed. If the decision rules 
have not decided to stop» i«e« 

dec 

u (8,t) « false, this is the srsrting point for a new cycle, 
sub 

To illustrate the use of the system eqations some of them will be 
discussed now, starting with the matching block: 

mtc stu sub 

u (l,t) - true,if z(l,t) - z (l,t) ; 
SCO mtc mtc 



mtc sub stu 

« (l,t) - true, if z (l+i,t) - true and 1+i - z (l,t); (I < i < 4) 
dec mtc ate 



The next block to be discussed is the score block, starting with the 
state ^'luations: 



SCO SCO dec mtc 

s (l,t+l) - s (l,t) + 1, if u (l,t) - next m,,d u (l,t) - true; 

SCO SCO SCO 



SCO dec fflte 

- s (l,t) , if u (l,t) - next and u (l,t) - false; 

SCO SCO 



dec 

■ 1 , if u (l,t) - (up or down or not-used) 

SCO 



mtc 

and u (l,t) • true; 

SCO 

dec 

" 0 , if u (l,t) ■ (up or down or not-used) 

SCO 
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mtc 

and u (l,t) " false; 

SCO 



SCO SCO 

(2,t+l) - s(2,t) +1 ; 



SCO SCO dec dec 

• (3.t+l) [i,J] - 9 (3,t) (1,J] + I, If u (2,t) « i and u (3,t) - J and 

SCO SCO 



dec 

(u (l,t) « up or dovn c- not-used) 

SCO 



dec 

and u (4,t) » false; 

SCO 



SCO dec dec 

6 (3.t) flj). If u (x.t) - i and u (3.t) - J and 

SCO SCO 

dec dec 
u (l,t) ■ next and u (4,t) ■ false; 

SCO SCO 

dec dec 

1 , If u (2.t) - I and u (3.t) - J and 

SCO SCO 

dec 

(u (l,t) * up or dovn or not-used) and 

SCO 

dec 

u (4»t) • true; 

•CO 
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dec dec 
, if u (2.t) - i and u (3,t) - j and 

SCO SCO 

dec dec 
u (I,t) " next and u (4,t) « true; 

SCO SCO 



•CO SCO SCO 

The three inforution equations for z (l.t), z (2.t) and z (3,t) Ii,j] 

dec dec dec 

coincide vith the state equations for 



SCO SCO SCO 

8 (l,t), s (2,.t) and s (3,t) [i.j]. respectively. 



The last block to be discussed is the decision block, starting with the 
decision equations vith respect to the subject aatter block: 



dec SCO sub sub 

u (l,t) - up, if E (l,t) > round (0,6 x z (2,t) and z (l,t) - false; 
•ub dec dec dec 



dec sub 
down, if s(3,t) > round (0,8 x z (2,t) and 

dec 



■CO sub sub 

z (I,t) < round (0,4 x z (z,t)) and z (l,t) « false; 
dec dec dec 



sub 

■ not-used, if z (l,t) ■ true ; 

■ next, else; 



In Words, the specified decision rules for tb: types T until III rua as 
follows: 

The up-pointer is activated if more than 60Z of questions in the frans 
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have bten anmred correctly. The down-pointer is activated either if 
■ore than BOX of the ouaber of questions in the fraoe have been answered 
and less than AOZ of then have been answered correctly or if all the 
questions in the fraae have been answered. In all other cases the next 
question in the fraae is presented^ 



dtc dec dec dec dec 

u (2.t) - 8 (l,t) and u (3,t) - s (2.t). if u (l,t) - next; 
sub sub sub 

dec sub dec sub dec 

u (2.t) - s (3,t) and u (3.t) « x (4.t). if u (l,t) - up; 
sub dec sub dec sub 

dec sub dec sub dec 

u (2,t) - s (5,t) and u (3.t) - s (6,t), if u (l,t) - down; 
sub dec sub dec sub 

dec sub dec sub dec 

u (2,t) - X (7 + i,t) and u (3.t) - 7 (11 + i,t), if m (l.t) - not used 
sub dec sub dec sub 



stu 

and X (l,t) - i; (1 < i < A), 
dec 

dec dec dec 

u (4»t) - s (3»t) 1. if u (l.t) - next; 
sub sub 



dec 

"1 » if u (l»t) " up, down or not-used; 

sub 

dec dec 
u (S,t) " true, if u (3»t) « maxioum level 1; 
sub sub 

d%c dec 
u (6,t) " true» if u (3»t) -> miniaum level -1; 
sub sub 
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dec SCO 

u (7,t) « true, If s (2,t) » aaxlmua number of permitted questions; 
sub dec 



The aazlaua level, nlnlnum level atA naxlaun number permitted questions 
in our example are put respectively on 3,1 and 50, 



dec dec dec dec 

u (8,t) * true, if u (5,t), u (6,t) or u (7,t) - true; 
sub sub sub sub 

dec SCO dec 

u (9,t) - true, if z (3,t). Ii,j] - 2 and u (2,t) - i and 
Sub dec sub 

dec mtc 
« " j and t (l,t) « true; 

sub dec 



In vords, this last decision rule runs as follows: Additional 
information is presented only each second time a student arrives at a 
frame which actually contains additional information- 



dec dec dec dec dec 

u (10, t) m 3 (i^t) and u (11, t) and u (12, t) » s (3,t) 
sub sub sub 



dec stu dec 

and u (13, t) - t (l,t), if u (9,t) « true; 
sub dec sub 



The decision equations with respect to the score block for 



dec dec 

u (l,t) until u (4,t) coincide with the decision equations for 

SCO SCO 

dec dec dec dec 

u n,t), u (2,t), u (3,t) and u (9,t), respectively, 

sub sub sub sub 
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Decision equations with respect: to the student block: 



dec dec 
« (Ift) - print (•sufficient aastery*). If u (5,t) - true; 
stu tub 



dec 

print (^Insufficient aastery')« If u (6«t) - true; 

sub 



dec 

print (• you are too long busy*). If u (7,t) - true; 

sub 



The three state equations of the decision block for 



dec dec dec 
s (l«t), 8 (z,t) and s (3>t) coincide with the decision equations for 



dec dec dec 
u (2tt)t u (3«t) and u (4«t)« re'ipectlvely. 
sub sub sub 
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